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TARGET  ACQUISITION  Ai^  ANA.T.YSIS  TRAINING  SYSTEM  (TAATS) : 
RETENTION  AND  EFFECTS  OP  RETRAINING 
INTRODUCTION 


Background 

Since  World  War  II,  considerable  Interest  has  been  shown  In  the  problems 
of  target  acquisition,  l.e.,  the  detection,  recognition,  and  Identification^  of  a 
target  sufficiently  well  to  permit  the  effective  employment  of  weapons. 

Although  great  technological  advances  continue  to  be  made,  the  human  eye,  when 
augmented,  still  provides  the  best  way  to  recognise  and  Identify  targets.  The 
heed  for  recognition  and  Identification  (R&I)  programs  derives  from  the 
diversity  of  vehicles  expected  on  the  modern  day  battlefield.  Among  the  many 
vehicles  used  by  our  allies,  some  look  different  from  ours  and  In  some  cases 
closely  resemble  those  of  nations  we  consider  to  be  potential  threats.  Training 
which  improves  the  soldiers'  R&I  ability  will  help  minimize  friendly  kills  and 
maximize  threat  kills. 

The  demands  on  human  performance  In  this  area  of>  recognition  and  Identifi¬ 
cation  have  been  Increasing  in  the  past  several  years.  It  has  been  generally 
accepted  that  the  threat  armored  forces  likely  to  be  engaq^ed  by  U.S.  and  other 
NATO  units  in  a  mld-to-hlgh  intensity  conflict  In  Europe  will  be  equipped  with 
antitank  missile  systems  that  are  both  accurate  and  lethal  at  ranges  extending 
beyond  3000  meters.  This  concern  is  made  even  more  acute  by  the  expectation 
that  the  threat-to-frlend  force  ratio  will  be  quite  large  (6:1).  This  general 
analysis  led  to  Increased  awareness  by  the  6th  Cavalry  Brigade  (Air  Combat)  as 
well  as  the  Armor  School,  Fort  Knox  and  the  US  Army  Intelligence  Center  and 
School,  Fort  Huachuca,  that  as  weapon  systems  change,  target  acquisition 
performance  (recognition  and  Identification)  must  be  Improved.  It  was  In  this 
context  that  FORSCOM's  Opposing  Force  Training  Detachment,  Red  Thrust,  In  1979 
and  1980  found  that  In  both  the  active  Army  and  Reserve  Components  no  standard 
recognition  and  Identification  training  program  existed.  In  response  to  these 
concerns,  the  US  Army  Research  Institute  for  Behavioral  and  Social  Sciences, 

Fort  Hood  Field  Unit,  with  the  support  of  the  Human  Resources  Research 
Organization,  Fort  Hood  (ARI/HumRRO) ,  undertook  a  research  program  to 
investigate  systematically  the  problem  of  recognition  and  identification, 
particularly  at  extended  ranges.  The  relevant  literature  leading  to  the 
development  and  evaluation  of  the  Basic  CVI  program  is  reviewed  in  some  detail 
by  Smith,  Heuckeroth,  Warnlck  and  Essig  (1980). 

Purpose  and  Scope  of  This  Research  Report 

Results  of  the  research  effort  by  Smith  et  al.  (1980)  indicate  that  R&I 
performance  generally  improves  significantly  following  Combat  Vehicle  Identifi¬ 
cation  (CVI)  training.  In  addition,  results  of  that  study  indicated  a 
noticeable  performance  decrement  between  training  on  five  Individual  modules  and  a 


^Detection  is  being  able  to  state  that  a  vehicle  has  come  into  the  field  of 
view.  Recognition  is  being  able  to  state  whether  the  vehicle  is  "friendly”  or 
"threat"  and  Identification  is  being  able  to  label  a  vehicle  by  its  common  or 
accepted  name,  or  its  correct  model  m<mber. 
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final  module  test  administered  within  two  days  after  training  was  completed.^ 
Based  on  these  findings,  it  was  of  practical  Interest  to  address  three 
additional  questions:  (1)  How  rapidly  do  acquired  R&I  skills  decay  when  not 
being  used?  (2)  Do  R&I  skills  decay  differentially  for  soldiers  differing  In 
background  factors?  and  (3)  What  Is  the  effect  of  retraining  which  follows  the 
original  training  at  some  later  time  (distributed  training)?  The  present 
research  addresses  these  questions  for  soldiers,  generally,  as  well  as  for 
those  differing  In  the  background  factors  of  GT  score,  rank,  HOS,  and  use  (or 
non-use)  of  glasses* 


2 

Five  training  modules  and  a  test  module  used  in  this  research  represent  a 
prototype  version  of  the  Basic  CVI  Program.  Vehicles  included  in  each  module 
of  the  prototype  version  are  Indicated  In  Appendix  D  of  the  Smith  et  al  (1980) 
report.  Other  characteristics  of  this  prototype  version  are  Identical  to  the 
Basic  CVI  Program  (GTA  17-2-9). 
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METHOD 


Research  Method 


Subjects  -  Soldiers  selected  for  participation  in  this  research  effort  were 
requested  through  FORSCOM  to  III  Corps.  To  complete  this  research  effort  a 
total  of  180  male  soldiers  from  combat  arms  units  (1st  Cavalry  and  2d  Armor 
Divisions  located  at  Fort  Hood,  Texas)  were  provided;  60  with  GT  below  89,  60 
with  GT  between  90  and  109  inclusive,  and  60  with  GT  110  or  above.  It  was 
further  stipulated  in  this  request  that  because  continued  participation  of 
these  soldiers  was  required  at  three  to  six  week  Intervals  over  a  13  week 
period  that  none  of  the  soldiers  provided  could  be  subject  to  transfe.  or 
discharge  or  be  assigned  to  schools  during  this  period. 

Procedure  -  Four  groups  of  45  soldiers  each  were  tasked  to  participate  in 
this  research  effort.  In  order  to  simplify  the  data  collection  effort, 
soldiers  provided  by  the  1st  Cavalry  Division  were  assigned  to  Groups  i  and  2; 
soldiers  for  groups  3  and  4  were  assigned  from  the  2d  Armored  Division. 

Figure  1  shows  the  data  collection  plan.  In  Figure  1  "Training”  refers  to 
training  soldiers  received  with  the  Basic  CVI  Program.' 

It  should  be  clear  from  review  of  Figure  1  that  this  research  effort 
Involved  a  longitudinal  data  collection  effort.  In  order  to  provide  a  data 
base  which  would  satisfy  our  research  objectives,  it  was  necessary  that  a 
sufficient  number  of  soldiers  actually  participate  in  each  scheduled 
training  and  testing  session.  Results  of  earlier  research  efforts  Indicated  t?te 
difficulty  of  having  soldiers  return  even  when  a  single  series  of  tiaining/test 
sessions  was  required.  This  effort  placed  an  even  greater  emphasis  on 
soldiers'  continued  participation.  To  Increase  the  llkllhood  that  this  need 
would  be  met,  the  battalion  commander  and  his  S3  from  the  12  units  providing 
troops  for  the  study  were  given  a  desk-side  briefing  which  outlined  the  value 
of  the  research  to  his  unit  and  the  Army.  In  addition  a  military  research 
coordinator  from  each  of  the  divisions  established  points  of  contact  (POC)  in 
each  company  and  personally  observed  each  training  session  so  that  he  could 
call  the  POCs  if  their  soldiers  did  not  appear. 

In  spite  of  these  additional  efforts  it  became  clear  even  after  the  first 
week  of  training  and  testing  that  the  sample  would  suffer  through  attrition  as 
the  study  progressed.  In  order  to  determine  which  planned  analyses  addressing 
the  research  objectives  could  be  performed,  it  was  necessary  at  the  conclusion 
of  the  data  collection  effort  to  determine  what  data  existed.  Soldiers  planned 

Training  in  the  Basic  CVI  Program  is  divided  into  six  training  modules  of  five 
vehicles  each,  followed  by  a  Final  Test  module.  Each  training  module  Includes 
presentation  of  three  Images  (a  front,  oblique  and  side  view)  of  each  of  five 
vehicles,  twice,  accompanied  by  a  spoken  description  of  distinguishing  vehicle 
characteristics.  The  Final  Test  module  is  composed  of  a  front  and  an  oblique 
view  of  each  of  the  30  vehicles  trained  in  the  program.  A  detailed  description 
of  the  Basic  CVI  Program  is  found  in  GTA  17-2-9.  During  this  research, 
soldiers  wci-e  trained  on  two  modules  per  day  for  each  of  three  consecutive 
days . 
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as  part  of  groups  2,  3A  or  3B  who  failed  to  attend  any  of  their  scheduled 
second  period  training  nodules  were  reassigned  to  either  Group  1  or  4. 

Soldiers  originally  assigned  to  Groups  1,  2,  3A  or  3B  who  attended  only  the  7 
June  pre  test  were  reassigned  to  Group  4.  Because  attrition  was  expected, 
reassignment  was  viewed  as  a  way  to  obtain  sample  sixes  which  would  tend  to 
Increase  the  reliability  of  any  findings  reported. 

In  order  to  evaluate  retention  performance  after  a  single  training 
session,  two  treatment  samples  were  defined.  One  sample  (n  ■  14)  was  composed 
of  soldiers  from  Group  1  who  completed  training  on  all  six  Basic  CVI  modules 
and  who  returned  to  be  tested  with  module  7  posttest  on  11  June,  28  June,  19 

July  and  9  August  (See  Figure  1).  Since  this  sample  was  relatively  small  a 

second  sample  (n  ■  48)  composed  of  soldiers  from  Group  1  and  Group  3A  was 
defined.  In  order  to  be  selected  for  this  sample,  the  soldier  had  to  have 
completed  training  on  all  six  CVI  modules  and  returned  to  be  tested  with  the 

module  7  test  on  11  June,  28  June  and  19  July  (See  Figure  1).  Data  for 

Group  3A  after  19  July  were  not  pertinent  to  this  analysis. 

In  order  to  evaluate  retention  performance  after  two  training  sessions,  a 
treatment  sample  composed  of  soldiers  from  Group  2  and  Group  3A  was  defined  (ii** 
13).  To  be  Included  In  this  sample  all  soldiers  had  to  have  completed  training 
on  all  six  Basic  CVI  modules  twice  and:  a)  soldiers  from  Group  2  had  to  have 
returned  for  testing  with  Module  7  on  2  July,  19  July  and  9  August  (See  Figure 
1);  b)  soldiers  from  Group  3A  had  to  have  returned  for  testing  with  Module  7  on 
23  July,  9  August  and  30  August  (See  Figure  1).  All  other  earlier  posttrainlng 
test  data  that  may  have  been  available  for  these  soldiers  were  not  pertinent  to 
this  analysis. 

In  order  to  evaluate  the  effects  of  retraining,  another  treatment  sample 
composed  of  soldiers  from  Group  2  and  Group  3A  was  defined  (n  ■>  19).  To  be 
Included  in  this  sample  all  soldiers  had  to  have  completed  training  on  all  six 
Basic  CVI  modules  twice  and:  a)  soldiers  from  Group  2  had  to  have  been  present 
for  Module  7  testing  on  7  June,  11  June,  28  June  and  2  July;  b)  soldiers  from 
Group  3A  had  to  have  been  present  for  Module  7  testing  on  7  June,  11  June,  19 
July  and  23  July  (See  Figure  1).  All  other  Module  7  test  data  that  may  have 
been  available  for  these  soldiers  were  not  pertinent  to  this  analysis. 

Data  Collection  Instruments  -  During  training  and  testing,  soldiers  were 
required  to  make  written  responses  each  time  a  vehicle  Image  was  projected. 

They  had  first  to  make  a  recognition  response — name  the  vehicle  as  a  friend 
(F),  threat  (T),  or  "Don't  Know"  (DK  or  ?) — and  then  attempt  to  Identify  the 
vehicle  by  name  (or  number)  or  Indicate  "Don't  Know  (DK  or  ?)  on  prepared 
answer  sheet i.  (See  Appendix  A  for  examples  of  training  and  test  worksheets.) 

Data  Analysis  -  Soldiers  responses  to  the  Module  7  tests  provided  the  basis 
for  defining  a  set  of  dependent  variables  for  data  analysis.  Among  the 
measures  were : 

1)  Number  of  Slides  Correctly  Recognized  (Front  and  Oblique  Views) 

2)  Number  of  Slides  Correctly  Identified  (Front  and  Oblique  Views) 
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3)  Number  of  Vehicles  Correctly  Recognized  (Front  or  Oblique  Views) 
A)  Number  of  Vehicles  Correctly  Identified  (Front  or  Oblique  Views) 


The  first  two  measures  are  defined  as  the  number  of  60  slides  In 
Module  7  to  which  a  correct  response  was  made;  the  latter  two  measures  are  the 
number  of  times  at  least  one  of  the  two  slides  for  each  vehicles  (front  and 
oblique  view)  yielded  a  correct  response.  It  Is  well  understood  that  these 
measures  are  correlated — Indeed  we  tfould  be  surprised  were  this  not  the  case. 

Use  of  correlated  measures  In  separate  analyses  has  been  motivated  by  questions 
raised  by  the  R&I  community.^ 

Since  the  research  described  herein  was  conducted  as  applied  research,  It 
was  appropriate  that  the  analytic  approach  selected  should  lead,  primarily,  to 
Implementahle  findings.  Accordingly,  most  of  the  analyses  Included  In  this 
report  utilize  within  and  mixed  design  analyses  of  variance  (ANOVA)^,”  and  the 
Duncan  Multiple  Range  Test.  In  each  case,  those  analyses  are  supported  by 
means  and  standard  deviations.  While  a  more  powerful  multiple  regression 
approach  to  ANOVA  (as  discussed  by  Cohen,  1968)  might  have  been  used  to  explore 
the  relationship  between  different  combinations  of  background  factors  (GT  score, 
rank,  MOS  and  use/non-use  of  glasses)  and  changes  In  retention  over  time,  for 
the  limited  data  available,  the  Importance  of  these  variables  was  more  easily 
assessed  with  the  simpler  within  and  mixed  design  ANOVAs  used. 


^Neither  type  of  measure  seems  Inherently  superior  although  "Number  of  Vehicles" 
type  measures  have  conceptually  greater  meaning  to  some  members  of  the  R&I 
community.  Measures  based  on  number  of  slides  provide  more  sensitive  measures 
of  program  effectiveness  and  permit  comparisons  of  present  findings  with 
results  presented  In  earlier  reports. 

^ANOVAs  were  performed  using  the  "BMDP-79  -  Biomedical  Computer  Programs 
p-Serles,"  Program  P2V,  published  by  the  University  of  California  Press,  1979. 

^It  Is  recognized  chat  in  several  Instances  questions  as  to  the  appropriateness 
of  using  ANOVA  may  arise.  Cell  dlsproportlonallty  and  marked  heterogeneity  of 
variance  can  make  It  prudent  to  be  cautious  In  the  interpretation  of  some 
slgnlfltance  tests.  Even  where  such  deviations  from  the  ANOVA  model  assump¬ 
tions  occur,  the  approach  has  been  to  formulate  the  hypotheses,  perform  the 
significance  tests  with  these  designs  and  Interpret  the  findings  in  light  of 
conformity  with  hypotheses  formulated  and  the  consistency  of  the  findings  with 
data  reported  by  other  investigators.  As  such,  the  philosophical  approach  has 
been  to  use  statistical  tests  only  as  tools  to  assist  in  evaluating  expecta¬ 
tions.  To  the  extent  these  tools  replicate  findings  reported  elsewhere,  the 
Inferences  drawn  take  on  a  greater  measure  of  validity.  According  to  this 
approach,  replicability  of  a  finding  Is  the  ultimate  test  of  Its  validity. 

When  a  finding  reported  Is  based  on  a  statistical  test  where  severe  violations 
of  the  model  assumptions  have  occurred  and  no  supporting  data  has  been  reported 
elsewhere,  a  conservative  approach  Is  to  present  the  findings  as  tentative 
conclusions  requiring  Independent  replication  prior  to  acting  as  If  the 
findings  are  factual.  Throughout  this  report  there  has  been  a  conscious 
attempt  to  be  sensitive  to  this  general  problem. 
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RESULTS 

Results  presented  in  this  report  are  designed  to  address  three  major 
questions:  (1)  Retention  performance — overall,  how  does  R  &  I  performance 
change  as  the  time  elapsed  since  training  Increases?;  (2)  Does  R&I  performance 
change  In  a  different  way  for  soldiers  varying  In  background  factors?,  and  (3) 

What  are  the  effects  of  retraining? 

Retention  Performance 

The  major  question  addressed  In  this  section  Is  how  performance  changes 
with  elapsed  time  since  training  was  completed.  Analyses  performed  to  address 
this  question  were  of  three  primary  types:  (1)  How  does  performance  change  as 
time  since  the  original  training  Increases?  (2)  How  does  performance  change  as 
time  since  the  second  training  period  was  completed?  and  (3)  How  do  changes  In 
performance  over  time  after  the  original  training  period  compare  with  the 
changes  which  occcur  after  a  second  training  period?  A  set  of  secondary 
analyses  was  also  performanced  to  address  questions  about  chemges  in 
performance  over  time  after  the  original  training  for  soldiers  differing 
In  GT,  rank,  HOS,  and  use/non-use  of  glasses. 

Changes  in  Performance  after  Original  Training 

Test  Period  -  Table  1  below  summarizes  results  of  analyses  which  address 
performance  change  as  a  function  of  time  elapsed  since  the  original  training 
was  completed.  That  table  presents  results  for  one  sample  (ji  “  48)  over  three 
test  periods  after  training  was  completed  (Sample  1)  and  a  smaller  sample 
(n  -  14)  for  four  test  periods  after  training  was  completed  (Sample  2). 

Results  presented  In  Table  1  are  generally  consistent  for  analyses  based 
on  each  sample.  Performance  Is  greatest  for  testing  Immediately  following 
completion  of  the  original  training  session  and  except  for  the  Number  of 
Vehicles  recognized  dependent  measure,  performance  In  the  next  test  period 
(three  weeks  later)  shows  a  significant  drop;  even  for  the  latter  dependent 
measure,  the  pattern  of  change  parallels  findings  for  other  dependent  measures. 

In  most  cases,  performance  beyond  the  third  week  after  training  shows  an 
apparent  improvement  over  the  three  week  test  period  performance.  In  order  to 
further  evaluate  these  mean  differences,  Duncan  Multiple  Range  Tests  were 
performed.  The  test  performed  for  the  Number  of  Slides  Recognized  scores  (Sample  1 
only)  indicated  that  performance  immediately  after  training  Is  significantly 
larger  than  during  the  test  period  three  weeks  later  (£  <.05);  neither  the 
differences  between  the  last  two  tf'st  periods  nor  between  the  first  and  third 
test  period  differed  significantly  (^^  >.05).  For  Number  of  Slides  Identified, 
performance  (Sample  1)  in  all  three  test  periods  differ  significantly  from  one 
another  (p^<.05).  For  Sample  2,  only  Number  of  Slides  Identified  performance 
Immediately  after  training  was  completed  differed  significantly  from 
performance  in  all  other  test  periods  (£  <.05).  Using  the  Number  of  Vehicles 
Identified,  results  for  both  samples  are  Identical — performance  Immediately 
after  training  is  significantly  greater  than  during  any  other  test  periods  (£ 

<.05);  no  performance  differences  between  any  of  the  later  test  periods  exist 
(^  >.05). 
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Table  1 


Changee  In  Perforaance  ee  e  Function  of  Tlae  Elapeed  After  a  Single  Training  Period  was  Completed 


Module  7 

Test  Dates 

Dependent 

Saaple 

ANOVA 

Period 

Period  2 

Period  3 

Period  4 

Measure 

Results 

11  Jun 

28  Jun 

19  Jul 

9  Aug 

1 

F(2.94)-4.38 

H 

40.08 

35.94 

37.92 

Number  of 

Slides 

n^48 

£<.02 

10.68 

12.78 

10.50 

- 

Recognised^ 

2 

F(3,39)-1.13 

M 

45.00 

40.26 

39.78 

40.14 

ti«14 

£>.05 

5.52 

12.78 

7.86 

11.94 

1 

F<2,94)-27.67 

M 

9.60 

5.40 

6.90 

Number  of 

Slides 

n-48 

£<.001 

SO 

8.46 

5.88 

6.00 

- 

Identified^ 

2 

F(3,39)-4.82 

M 

11.70 

7.08 

8.10 

8.64 

n“14 

£<.01 

10.02 

6.90 

6.48 

6.30 

1 

F(2,94)-2.86 

M 

25.00 

23.12 

24.15 

Number  of 
Vehicles 

n_«48 

£>.05 

SO 

5.62 

7.20 

5.57 

— 

Recognised^ 

2 

F(3,39)<1 

M 

27.07 

24.43 

24.86 

24.50 

n“14 

£>.05 

2.09 

7.26 

3.66 

6.78 

1 

F(2,94)-27.46 

M 

7.17 

4.17 

5.40 

. 

Number  of 
Vehicles 

n^48 

£<.001 

5.80 

4.32 

4.45 

• 

Identified  ’ 

2 

F(3,39)-6.37 

M 

8.57 

5.07 

6.29 

6.43 

w«l4 

£<.01 

6.58 

4.81 

4.86 

4.48 

^Samples  are  defined  In  the  METHOD  Section. 

^Period  1  test  was  first  Module  7  test  given  one  day  after  completing  the  original  training  period.  No 
additional  CVI  training  was  provided  before  subsequent  test  periods. 

O 

-’For  each  soldier  there  were  2  presentations  of  each  of  30  different  vehicles  for  the  total  of  60  slide 
presentations  on  each  Module  7  Test  Date. 

^For  each  soldier  there  were  30  different  vehicles  presented.  Maximum  possible  score  of  30.  Credit  for  a 
vehicle  was  recorded  If  a  correct  response  was  reported  for  either  (or  both)  slides  presented  for  each 
vehicle . 
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Test  Period  and  Vehicle.  In  order  to  determine  whether  performance 
degrades  selectively  for  different  vehicles,  analyses  of  variance  were 
conducted  for  recognition  and  Identification  scores.  Since  the  pattern  of 
performance  over  test  periods  using  Samples  1  and  2  was  essentially  the  same 
In  most  cases,  all  subsequent  analyses  were  based  on  the  larger  sample — Sample 
1.  Means  and  standard  deviations  showing  changes  In  recognition  and 
Identification  performance  of  each  vehicle  over  three  test  periods  are  shown  In 
Table  2. 

Results  of  analysis  of  these  differences  Indicated  no  differential  change 
In  recognition  performance  for  different  vehicles  over  time  [£(58,2726)  »  1.17, 
^>.05];  vehicle  Identification  performance,  however,  does  show  differential 
performance  changes  over  test  periods  following  the  original  training 
[£(58,2726)  -  1.80,  p  <.001].  Review  of  Table  2  reveals  two  basic  findings: 

1)  Between  the  11  June  and  23  June  testing,  performance  for  most  vehicles 
declines;  and  2)  for  at  least  tvo- thirds  of  the  vehicles,  performance  on  19 
July  shows  some  Improvement  or  stays  the  same  as  28  June  performance. 

Since  no  CVI  training  was  provided  for  these  soldiers  between  test 
periods,  the  significant  Improvement  In  Number  of  Slides  Identified  performance 
between  the  second  and  third  test  period  deserves  further  mention.  The  pattern 
of  change  suggests  chat  between  28  June  and  19  July  soldiers  were  Involved  In 
activities  which  affected  R&I  knowledges.  During  July  of  each  year  the  A9th 
Armored  Division j  Texas  National  Guard  comes  to  Fort  Hood  for  training 
exercises.  This  training  makes  use  of  several  of  the  armored  vehicles  Included 
In  the  CVI  program — specifically  the  M113,  M109  and  M48.  The  considerable 
exposure  to  these  vehicles  by  1st  Cav  and  2AD  troops  which  support  this 
training  could  well  have  supplemented  many  of  these  soldiers'  R&I  knowledges. 
Review  of  Table  2  Indicates  that  the  performance  Improvement  on  these  vehicles 
from  the  28  June  to  19  July  test  periods  was  relatively  large.  When  this 
analysis  was  repeated  eliminating  those  vehicles  (as  well  as  the  M60  and  MI 
also  present  at  Fort  Hood),  changes  In  Number  of  Slides  Identified  performance 
between  these  two  later  test  periods  are  no  longer  significant  (^  >.05). 

Examining  retention  performance  on  different  vehicles  Is  Important  to  both 
the  trainer  and  program  developer.  For  the  trainer,  above  average  performance 
loss  Indicates  those  vehicles  requiring  special  training  emphasis;  for  the 
developer,  such  performance  provides  a  rationale  for  development  of  special 
remedial  training  modules.  In  order  to  address  this  concern,  performance  data 
for  each  vehicle  on  11  and  28  June  presented  In  Table  2  were  used.  For  each 
vehicle,  recognition  and  Identification  performance  differences  were 
Independently  summed  and  divided  by  30  to  yield  an  average  difference — one  for 
recognition,  one  for  identification.  Vehicles  showing  above  and  below  average 
performance  differences  on  both  measures  were  tabled  (See  Table  3).  Vehicles 
for  which  the  loss  is  notably  high  or  low  (.1  from  the  mean  difference)  are 
highlighted  (*).  Identical  analyses  were  performed  for  data  reported  by  Smith 
et  al.  (1980).  Vehicles  In  that  research  showing  the  same  pattern  of 
differences  are  underlined  in  Table  3. 
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Tsble  2 


Means  and  Standard  Devl4ttont  of  Number  of  Sltdaa  Recognized  and  Identified  for  Each  Vehicle 


Over  Three  Teat  Periods  Following  a  Single  Training  Period^ 


RECOGNITION 

1 

IDENTIFICATION 

Vehicles^ 

Period  1 

11  Jun 

M  SD 

Period  2 

28  Jun 

M  ^ 

Period  3  I 

19  Jul  1 

M  SD  1 

~  1 

Period  1 

11  Jun 

M  ^ 

Period  2 

28  Jun 

M  ^ 

Period  2 

19  Jul 

M  SD 

T62 

1.33 

.72 

1.35 

.73 

1.33 

.75 

.44 

.62 

.27 

.49 

.38 

.53 

RTR60F 

1.38 

.67 

1.29 

.71 

1.19 

.67 

.04 

.20 

.00 

.00 

.02 

.14 

LEO 

1.46 

.62 

1.33 

.75 

1.48 

.68 

.10 

.31 

.10 

.31 

.19 

.39 

M113 

1.75 

.60 

1.42 

.82 

1.50 

.68 

.92 

.85 

.62 

.79 

.81 

.84 

SCORP 

1.33 

.81 

1.31 

.83 

1.33 

.78 

.29 

.54 

.21 

.50 

.31 

.66 

BMO 

1.62 

.61 

1.44 

.74 

1.56 

.62 

.06 

.24 

.00 

.00 

.06 

.24 

M60A1 

.98 

.56 

.85 

.62 

1.04 

.54 

.38 

.49 

.29 

.46 

.35 

.48 

ASU8S 

1.15 

.77 

1.04 

.80 

1.10 

.75 

.12 

.39 

.04 

.20 

.04 

.20 

AMX13 

1.46 

.71 

1.15 

.77 

1.25 

.76 

.27 

.64 

.19 

.53 

.27 

.57 

M109 

1.62 

.53 

1.54 

.68 

1.71 

.58 

1.21 

.85 

.81 

.84 

1.04 

.92 

M48 

.83 

.83 

.90 

.78 

.96 

.85 

.23 

.53 

.06 

.32 

.27 

.49 

SALA 

1.15 

.74 

1.12 

.84 

1.17 

.81 

.44 

.71 

.10 

.37 

.21 

.50 

ZSU234 

1.50 

.71 

1.33 

.81 

1.31 

.80 

.29 

.58 

.15 

.46 

.17 

.48 

BTRSO 

1.50 

1.29 

.77 

1.12 

.73 

.10 

.37 

.04 

.20 

.02 

.14 

XMl 

1.60 

.64 

1.31 

.78 

1.56 

.71 

.83 

.78 

.48 

.65 

.62 

.64 

PT76 

1.58 

.68 

1.33 

.78 

1.50 

.74 

.15 

.41 

.12 

.44 

.10 

.42 

SCIM 

1.52 

.68 

1.42 

.77 

1.29 

.77 

.35 

.67 

.10 

.42 

.08 

.^8 

HARDER 

1.35 

.76 

1.19 

.,70 

1.27 

.71 

.40 

.71 

.25 

.33 

.17 

.48 

T72 

1.06 

.78 

.77 

.75 

.85 

.77 

.21 

.50 

.06 

.24 

.19 

.49 

AMX30 

.98 

•  .79 

.96 

.74 

.90 

.78 

.23 

.56 

.17 

.48 

.15 

.41 

ZSU372 

1.44 

.'68 

1.33 

.83 

1.10 

.33 

.17 

.48 

.10 

.42 

.10 

.42 

JAGD 

.85 

.80 

.92 

.87 

.85 

.85 

.25 

.64 

.19 

.57 

.27 

.61 

T54/5S 

1.33 

.69 

1.15 

.77 

1.46 

.68 

.17 

.38 

.17 

.43 

.17 

.43 

ROLAND 

.96 

.82 

.90 

.75 

1.12 

.82 

.21 

.54 

.10 

.42 

.04 

.20 

CHIEF 

1.52 

.65 

1.31 

.78 

1.50 

.68 

.27 

.54 

.12 

.33 

.19 

.39 

BRDH 

1.42 

.71 

1.29 

.74 

1.38 

.73 

.33 

.67 

.06 

.24 

.10 

.31 

CEN 

1.54 

.65 

1.21 

.80 

1.42 

.71 

.38 

.61 

.12 

.44 

.12 

.39 

BMP 

1.46 

.74 

1.52 

.74 

1.44 

.71 

.12 

.33 

.06 

.24 

.12 

.33 

•SP74 

1.25 

.79 

1.08 

.74 

1.12 

.76 

.38 

.67 

.29 

.58 

.21 

.58 

GEP 

1.17 

.81 

.90 

.72 

1.06 

.78 

.21 

.54 

.08 

.35 

.10 

.37 

i»  “  48 

See  Footnoca  2,  Table  1 

For  each  soldier  there  were  2  slide  presentlons  on  each  vehicle  on  each  Module  7  Test  Date — Daxlmum  score  Is  2. 
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Table  3 


Vehicles  Whose  Performance  Dlfferencea  Between  11  June  (Module  7) 
Posttest  and  28  June  (Module  7)  Posttest  Are  Greater  or  Less  than 
Mean  Performance  Differences  (for  All  Vehicles)! 


Identification  (Mean  Performance  Difference  “  '*'.070) 


Below 

Mean 

Above  Mean 

Recognition 

(Mean 

Performance 

Below 

Mean 

BTR60 

LEO* 

*SC0RP 

M60 

ASU85 

*AMX30 

ZSU572 

*JAGD 

ROLAND 

*BMP 

*T62 

*M109* 

*M48 

*SALA* 

SCIM* 

BRDM* 

Difference  “ 
+.069) 

BMD 

SP74 

*M113 

CHIEF 

Above 

*AMX13 

*GEP 

ZSU234 

*CEN* 

Mean 

BTR50 

*PT76* 

T54/55* 

*M1* 

MARDER 

*T72 

^  *  To  the  left  of  a  tabled  vehicle  name  means  that  the  recognition  performance 
difference  is  at  least  .1  from  the  mean  performance  difference;  *  to  the  right  has 
comparable  meaning  for  Identification  performance. 

Vehicles  where  performance  loss  is  greater  than  average  provides  evidence 
which  is  consistent  with  the  recommendation  that  added  training  (or  retraining) 
emphasis  is  warranted.  Taken  together  the  findings  from  analysis  of  the  Smith 
et  al.  (1980)  data  and  the  current  research  point  to  the  importance  of  added 
training/retraining  on  the  ZSU23A,  MARDER,  CHIEF  and  CEN  and  the  relatively 
lesser  importance  of  such  training  on  the  LEO,  M60,  ZSU572  and  JAGD.  It  needs 
to  be  emph  isized  that  especially  because  Identification  performance  is 
uniformly  ..ow  on  most  vehicles,  these  conclusions  are  based  on  relative 
comparisons.  Once  the  Army  has  formulated  R&I  criterion  performance  levels, 
those  requirements  should  drive  the  training/retraining  need.  Viewed  in  this 
context,  the  above  conclusions  could  reasonably  be  used  as  a  basis  for  some 
modification  of  the  training  materials — even  if  during  the  training  only  a 
statement  to  highlight  their  difficulty  is  added. 

Test  Period  and  Angle  -  The  pattern  of  performance  change  over  test  periods 
generally  did  not  differ  significantly  between  vehicles  presented  in  the  front 
view  and  vehicles  presented  in  the  oblique  view.  For  slides  recognized  [F^ 

(2,94)  =  2.33,  £  >.05];  for  slides  identified  [F  (2,94)  =  1.31,  £  >.05]. 
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Test  Period  and  Background  Factors  -  In  order  to  determine  whether 
retention  performance  varies  as  a  function  of  background  factors,  several 
analyses  of  variance  were  performed.  Results  of  those  analyses  together  with 
mean  performance  differences  for  each  background  variable  over  three  test 
periods  are  presented  In  Tables  4  and  5. 

In  these  analyses,  an  attempt  was  made  to  define  categories  of  each 
background  factor  so  that  results  reported  here  would  be  comparable  to  findings 
reported  In  previous  studies.  Categories  of  MOS  were  defined  by  placing 
soldiers  having  like  MOS's  Into  Combat  Arms  groups  corresponding  to  MOS  type. 
Categories  chosen  for  Rank  were  selected  so  as  to  arrive  at  sample  sizes 
which  would  Increase  the  reliability  of  performance  measures  reported. 

A  review  of  mean  recognition  performance  for  different  background 
categories  In  Table  A  Indicates  no  significant  relationships  were  found  using 
recognition  performance  for  any  differences  In  GT  score,  rank,  MOS  or  use/non 
use  of  glasses.  Table  5  Indicates  that  Identification  performance  Increases 
significantly  as  a  function  of  GT  score.  Further,  there  Is  a  tendency  for 
Identification  performance  to  Increase  with  rank  and  to  be  superior  for 
soldiers  holding  an  Armor  MOS.  As  with  recognition  performance,  the  data 
Indicate  no  meaningful  relationship  based  upon  the  soldiers'  use  or  nonuse  of 
glasses.  Findings  In  these  tables  also  Indicate  that  generally  neither  recog¬ 
nition  nor  Identification  performance  changes  In  a  different  manner  over  test 
periods  for  different  categories  of  the  background  variables^. 


^Examining  means  for  changes  In  Identification  performance  of  MOS  groups  over 
test  periods  Indicates  that  this  relationship  Is  largely  a  consequence  of  the 
markedly  greater  drop  between  the  first  and  second  test  period  by  Armor 
soldiers  than  for  those  with  Artillery  or  Infantry  MOS.  Neither  the  meaning 
nor  importance  of  this  difference  are  clear. 
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Table  4 


Raaulta  From  Analyaea  of  Recognition  Perforaanca  for  Selected  Background  Factorg  (BF)  Over  Three 
Teat  Perlode  (11  June,  28  June,  19  July)  Following  a  Single  Training  Period^ 

Background  Factort  (BF) 


1  sv 

1  1 

ISTATl  GT 

1  1 

1 - 

1  RANK 

1 

- 1 - p 

1  MOS  1 

1  1 

GLASSES 

1  BF^ 

1 

1 

1 

1  1 

1  I 

|F(2.45)-2.48.p>.05 

|F(3.44)-2.49.p>.05 

|F(2,39)-1.98,p>.05  |F(1,43X1.P>.05 

1  n 

1  15  13  20 

1  12  17  IS 

4  1  10  17  15  1 

11  34 

1  <89  90-109  IlOf 

1  E1E2  E3  £4 

E5E8  j  Inf  Artil  Armor  j 

Yes  No 

1  M 

134.32  36.90  41.46 

133.60  38.46  42.48 

32.34  139.24  34.98  42.00  j 

40.32  37.38 

1  SD 

110.26  11.88  7.14 

111. 28  6.78  6.78 

19.50  j  6.42  9.60  12.36  j 

6.30  11.04 

1  BF 

1  X 

1 

1 

1 

1 

1 

1  1 

1  1 

1  Period 

1  F 

|F(4.90)<l.p>.05 

1f(6.88X1.P>*05 

|F{4,78X1,P>.05  |F(2,86)-2.37, 

1 

1 

1 

1  1 

£>.05 

1  BF 

1  X 

1 

1 

1 

1 

1 

1 

1  1 

1  1 

1  Period 

1 

1 

1 

1  1 

1  X 

1  F 

|F(116. 2610X1, p>.0S 

|F(174,2552X1.P>.05 

|F(116,2262)-1.05,  |F(58,2494X1, 

1  vehicle  1 

1  1 

1 

1 

1  £>.05  1 

£>.05 

i  BF 

1  X 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1  1 

1  1 

1  1 

1  Period 

1 

1 

1 

1  1 

1  X 

1  F 

IF(4,90)<1,p>.05 

|F(6,88)-I.14.p>.05 

|F(4,78)-2.03,p>.05  |F(2,86)-1.69, 

1  view 

1 

1  1 

£>.05 

^For  each  soldier  there  uere  two  presentations  of  each  of  30  different  vehicles  for  the  total  of  60  slide 
presentations  on  each  Module  7  Test  Date>  Row  M  indicates  the  average  nunber  of  slides  correctly  recognized 
by  the  particular  CT,  rank,  etc.  group. 

^Background  Factor.  For  reading  entries  In  any  column,  substitute  In  Column  1  for  "BF"  the  particular 
Background  Factor  shown  at  the  top  of  the  colusin  of  Interest. 


13 


Tabla  S 


Raaulta  Froa  Analytlt  of  Idantlfl^atlon  Parfor—nca  for  Salectad  Background  Factorg  (BF)  Over 
Thraa  Taat  Parloda  (11  Juna.  23  Juga.  19  July)  Following  a  Single  Training  Period^ 

Background  Factora  (BF) 


1 

1  sv 

1 

1  1 

(STAT( 

!  ( 

GT 

1 

(  RANK 

! 

- 1 - 

1  MOS 

1 

1 

1  GLASSES 

! 

! 

! 

1  BF^ 

1 

F 

( 

(F(2.45)-6.7l.p<.01 

(F(3.44)-1.59.p>.05 

1 

!f(2.39)-2.84.p>.05 

1 

iF(l,43)-1.86, 

! 

1 

! 

( 

(  £>.05 

( 

1 

( 

n 

(  15 

13  20 

(  12  17  IS 

4  1  10  17  15 

(  11  34 

! 

1 

( 

(<89 

90-109  llOf 

(  E1E2  E3  E4 

E5E8(  Inf  Arcll  Armor 

(  Yes  No 

( 

1 

! 

M 

(4.14 

S.46  10.86 

(  3.84  8.34  8.S8 

8.521  6.12  6.48  11.16 

1  5.04  8.04 

( 

1 

i 

SO 

(2.82 

5.28  7.50 

1  2.82  7.80  6.54 

6.301  6.36  3.48  8.40 

1  4.50  6.84 

! 

1  BF 

1  X 

! 

( 

( 

( 

( 

! 

! 

( 

( 

( 

! 

! 

1  Period 

( 

F 

(F(4.90)-1.72.p>.03 

|F(6.88)-1.28.p>.05 

(F(4.78)-3.51.p-.01 

|F(2,56)-1.67, 

( 

1 

1 

! 

1 

1 

1 

1 

1  £>.05 

( 

1 

1  BF 

1  X 

( 

( 

( 

( 

( 

( 

( 

( 

! 

( 

( 

( 

(Period 

( 

( 

( 

! 

( 

! 

1  X 

( 

F 

!f(116. 2610X1, p>.OS|F(174.2552)<1,p>.OS 

!f(116.2262)-1.18. 

|F(58,2494X1, 

! 

1 Vehicle! 

1  1 

! 

( 

(  £>.05 

(  £>.05 

! 

( 

1 

1  BF 

1  X 

1 

( 

( 

! 

( 

( 

( 

( 

( 

! 

( 

( 

! 

( 

( 

( 

( 

( 

(period 

1 

! 

( 

( 

( 

! 

1  X 

( 

F 

(F(4,90X1i£>*05 

(F<6,88Kl,JP>*05 

(F(2,78)<1,p>.05 

(P(2,86)<l,i>>.05 

( 

(view 

( 

1 

( 

^For  each  soldier  there  were  two  preseatatlons  of  each  of  30  different  vehlclea  for  the 
60  allde  presentations  on  each  Nodule  7  Test  Date.  Row  M  Indicates  the  average  nunber 
correctly  Identified  by  the  pattlcular  GX,  rank,  etc.  group. 

^Background  Factor.  For  reading  entries  In  any  coliusn,  substitute  In  Column  1  for  "BF" 
particular  Background  Factor  shown  at  the  cop  of  the  column  of  Interest. 


total  of 
of  slides 

the 
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Performance  Change  After  Two  Complete  Training  Periods 


From  review  of  the  Data  Collection  Plan  (Figure  1),  It  Is  noted  that  only 
soldiers  In  Groups  2  and  3A  could  receive  two  complete  training  periods 
(training  on  Modules  1-6)  and  a  total  of  three  Module  7  posttraining  tests 
after  completion  of  the  second  training  period.  As  noted  earlier  (see  Method 
procedure),  soldiers  who  actually  satisfied  these  conditions  were  selected  as 
the  treatment  sample.  Each  of  the  dependent  variables  for  this  sample  were 
cast  into  a  mixed  design  analysis  of  variance  where  the  portion  of  the 
treatment  sample  from  each  Group  were  levels  of  a  between  subjects  variable  and 
test  period  was  the  within  subjects  variable.  Had  sample  sizes  of  each  Group 
been  somewhat  larger  and  greater  comparability  on  several  background  factors 
existed.  Groups  could  have  defined  a  variable  named  "Time  Between  Training 
Periods.”  However,  because  these  conditions  could  not  be  satisfied  with  the 
limited  data  available,  Incorporaton  of  Groups  as  a  variable  In  the  design  Is 
best  viewed  simply  as  a  way  to  partition  out  variability  from  the  error  term. 
This  procedure  creates  a  more  powerful  statistical  test  of  performance  changes 
across  test  periods.  Means  and  standard  deviations  supporting  statistical 
tests  are  found  In  Table  6 . 


Table  6 

Changes  In  Performance  as  a  Function  of  Time  Elapsed  After  a  Second 
Training  Period  Was  Completed  (n"13) 


Module  7  Test  Periods^ 


Dependent 

Measure 

ANOVA 

Results 

Test 

Period  1 

Test 

Period  2 

Test 

Period  3 

Slides 

Recognized^ 

F(.  '’.2)-1.48,  2  >*05 

M 

44.46 

41.16 

43.02 

(Total) 

Slides 

ii: 

10.62 

14.40 

10.92 

Identified^ 

F(2,22)-17.59,  £  <.001 

M 

15.36 

10.26 

10.02 

(Total) 

12.66 

8.46 

8.58 

No .  Vehicles 

F(2,22)<1,  £  >.05 

M 

26.54 

25.38 

25.77 

Recognized'^ 

3.76 

7.10 

3.32 

No.  Vehicles 

F(2,22)-20.28,  £  <.001 

M 

10.31 

7.46 

6.92 

Identified^ 

IE 

7.65 

5.78 

5.41 

^  For  all  soldiers  used,  test  period  1  occurred  the  day  following  completion  of 
the  second  training  period;  later  test  periods  are  separated  by  approximately 
three  week  Intervals  with  no  Intervening  CVI  training. 

^  See  footnote  3,  Table  1. 

^  See  footnote  4,  Table  1. 
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Test  Period  -  Neither  Number  of  Slides  Recognized  nor  Number  of  Vehicles 
Recognized  dependent  measures  showed  significant  changes  over  test  periods  (£ 
>.05);  however,  both  Number  of  Slides  Identified  and  Number  of  Vehicles 
Identified  dependent  measures  show  significant  performance  decay  (j^  <.001). 
Duucan  Multiple  Range  Tests  indicated  that  only  the  performance  decrement  noted 
between  the  first  and  latter  two  test  periods  were  significant  <.0S); 
differences  between  second  and  third  test  periods  were  not  significant 
>.05).  Means  and  standard  deviations  together  with  overall  statistical  analyses 
supporting  these  conclusions  are  presented  in  Table  6. 

Comparison  of  Performance  Change  After  One  versus  Two  Complete  Training  Periods 

Regardless  of  whether  the  first  or  second  training  period  is  considered, 
performance  is  greatest  on  the  first  test  immediately  following  the  training 
period  and  declines  to  a  point  where  it  remains  relatively  stable  from  three  to 
six  weeks  later  (Data  supporting  these  conclusions  are  found  in  Tables  1  and 
6).  While  the  findings  appear  similar  in  both  tables,  the  comparability  of  the 
sample  used  is  unknown.  In  order  to  better  assess  the  differences  in  perform¬ 
ance  change  after  one  versus  two  training  periods,  a  special  set  of  analyses 
was  planned.  To  better  assure  that  performance  following  one  and  two  training 
sessions  could  be  compared  independently  of  sample  characteristics,  matched 
samples  for  the  two  major  treatment  conditions  were  created.  Characteristics 
selected  for  matching  included  GT,  rank,  MOS  and  use/non-use  of  glasses  on  the 
job.  Performance  of  the  13  soldiers  included  in  Group  2  and  Group  3A  for  the 
three  test  periods  following  the  second  training  session  defined  one  of  the 
major  treatment  groups.  The  background  characteristics  of  these  13  soldiers 
were  used  to  select  another  13  soldlerp  (matched  on  those  characteristics)  from 
the  48  soldiers  who  were  Sample  1  (See  Table  1  ).  Performance  of  these  latter 
13  soldiers  for  the  three  periods  following  their  first  training  session  con¬ 
stituted  the  other  treatment  group.  Results  of  analyses  performed  were 
generally  consistent  in  showing  that  regardless  whether  one  or  two  training 
periods  were  received,  .patterns  of  decay  from  a  time  after  training  to  three 
and  six  weeks  later  shovs  no  significant  difference — for  Slides  Recognized, 
jF(2,4d)  *  1.29,  £  >.05,  for  Slides  Identified,  F(2,48)  1.04,  £  >.05,  for 

Number  of  Vehicles  Recognized,  £(2,48)<1,  £  >*05,  or  Number  of  Vehicles 
Identified,  ^(2,48)  ■  1.37,  £>.05.  These  findings  imply  that  performance  decay 
after  one  training  session  follows  the  same  pattern  as  for  soldiers  who  have 
received  two  training  sessions — when  the  interval  between  training  periods  is  3 
to  6  weeks  apar<^ . 

Effects  of  Retraining  (Recovery) 

From  review  of  the  Data  Collection  Plan  (Figure  1),  it  is  noted  that  only 
soldiers  in  Gro  ips  2,  3A  and  3B  were  scheduled  to  receive  two  training  periods 
during  the  stuay.  In  order  for  a  soldier  to  be  considered  for  inclusion  in 
analyses  to  assess  differences  in  the  effects  of  training  and  retraining,  all 
training  modules  in  both  scheduled  periods  had  to  have  been  completed  in 
addition  to  module  7  tests  which  immediately  preceded  and  followed  each  training 
period.  Group  3B  was  not  included  in  the  analyses  as  the  number  of  cases 
available  was  exceedingly  small  (n  =  4)  and  the  time  between  training  periods 
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quite  lengthy.  To  the  extent  lengthy  time  between  training  sessions  is 
important  and  the  small  sample  sise  contributes  to  unreliability  in  the  data, 
inclusion  of  other  data  would  probably  liave  increased  variability  in  the  data 
inalysed — a  condition  which  would  have  contributed  to  a  less  efficient 
statistical  test  of  the  effects  of  retraining.  Training  periods  for  the  two 
remaining  samples  (Groups  2  and  3A)  were  3  and  6  weeks  apart,  respectively.  For 
these  groups  module  7  tests  wete  available  on  dates  shown  in  Table  7 . 

Tabic  7 

Dates  Module  7  Tests  Had  to  be  Available  for  Treatment  Groups^ 


Period  1 

Period  2 

Period  3 

Period  4 

Group  2 
(n-7) 

7  June 

11  June 

28  June 

2  July 

Group  3A 
(n-12) 

7  June 

11  June 

19  July 

23  July 

^  All  soldiers  completed  cralnlng  on  all  six  modules  of  the  Basic  CVI  program 
between  periods  1  and  2,  and  between  periods  3  and  4,  respectively. 


Since  the  major  question  addressed  was  the  significance  of  changes  in 
perfoirmance  between  pretraining  and  posttraining  test  for  each  training  session, 
all  analyses  made  use  of  difference  scores-'-period  2  minus  period  I  and  period  4 
minus  period  3 — Slides  Recognized  (Total)  and  Slides  Identified  (Total)  as  well 
as  Number  of  Vehicles  correctly  Recognized  and  Identified.  Each  of  these  scores 
was  cast  into  a  mixed  design  ANOVA  where  the  portion  of  the  treatment  sample 
from  each  group  were  levels  of  the  between  subjects  variable  and  each  test 
period  difference  was  the  within  subjects  variable.  Since  soldiers  comprising 
Groups  2  and  3A  came  from  different  divisions  as  well  as  having  different 
lengths  of  time  between  training  sessions — a  condition  characterized  in  statis¬ 
tics  as  confounding — the  between  subjects  variable  (Groups)  was  Included  in  the 
design  only  to  partition  variability  from  the  error  term,  and  thereby  create  a 
more  efficient  statistical  test  of  the  differences  in  effectiveness  of  each 
training  period  on  R&I  performance. 

Test  Period  -  To  assess  the  importance  of  repeated  training,  it  was  of 
interest  to  determine  the  relative  importance  of  successive  training  periods  on 
performance  change.  Means  and  standard  deviations  together  with  results  of 
statistical  analyses  are  summarized  in  Table  8.  From  review  of  this  table,  it 
is  noted  that  regardless  of  what  dependent  measure  was  used,  performance 
improved  significantly  between  each  pretraining  and  posttraining  test  (See 
columns  2  and  3,  Table  8);  however,  only  the  recognition  measures  showed  sig¬ 
nificant  differences  in  the  amount  of  pretraining  to  posttraining  test  change 
surrounding  each  training  period  (See  column  1,  Table  8).  Generally,  the  amount 
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of  perfot>r.:?nce  recognition  improvenent  is  greeter  following  the  first  training 
period;  lev  identification  measures,  the  improvement  from  each  pretraining  to 
posttra'lning  test  is  about  equal.  It  is  encouraging  to  note  here  that  successive 
training  sessions  will  lead  to  significant  improvements  in  performance — not 
simply  recovery  in  performance  lost  through  decay,  but  an  improvement  beyond  that 
attained  by  the  end  of  the  first  training  session. 
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Tabla  8 


Raaultt  Froa  Analysis  of  Chanaas  In  Parforaanca  Froa  Pratralnlna  to  Posttralnlns  Tsst 


SurroundlnA  Bach  Tralnlna  Parlo 


EMCOUI 


Dapandant 

Maasuroa 


Racognlsad^ 

(Total) 


Idantlflad^ 

(Total) 


No*  Vahlclea 
Racognlsad^ 


No*  Vahlclea 
Idantlflad^ 


Dllfecencas  In  ' 
Pratralnlng  to  Poattralnlng 

Taata 

Changes^ 


P(1,17)-5.37,2<.05  M 

SO 


F(1,17)<1,£>.05 


F(1,17)-3.74,£<.05 


F(l,17)-l.l3,j>.05 


First  Training  )‘  iod  I  Second  Training  Porlod 

Pratralnlng  Posttralnl-ig  j  Pretraining  Poattralnlng 

Teats  I  Teats 


28.S6  39.84 

14.04  6.72 

F(1,18)-IS.82,£<.001 


1.08  7.26 
2.04  6.96 
F(l,l8)-23.99,£<.00l 


19.42  2S.74 

a.S8  2*23 

F(1,18)-13.37,£<.01 


1*00  S.S8 

1.86  S.08 

F(1,18)-31.36,£<.001 


38.76  42.78 

7.08  9.72 

F(1,18)-6.94,£<.025 


5.10  12.06 

5.10  11.64 

F(1,18)-17.14,£<.001 


24.42  26.16 

2.65  3.55 

F(l,18)-6.01  ,£<.025 


4.00  8.32 
3.68  7.23 
F(1,18)-20.28,£<.001 


^Analyses  of  differences  In  preeralnlng  test  to  poattralnlng  test  changes  vers  based  on  calculaclon  of  performance 
difference  scores  for  each  soldier. 

^Sae  footnote  3,  Table  1. 

^Sae  footnote  4,  Table  1. 
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DISCUSSION 


Background  and  Method 

Four  groups  of  45  soldiers  each  were  selected  from  the  Ist  Cavalry  and  2d 
AO  at  Fort  Hood,  Texas,  to  participate  In  a  research  effort  designed:  1)  to 
assess  retention  of  combat  vehicle  recognition  and  identification  performance 
skills  as  a  function  of  time  elapsed  since  training;  and  2)  to  determine  the 
effects  of  retraining.  A  control  group  was  never  trained  but  va  tested  at  three 
week  Intervals.  All  remaining  groups  were  tested  before  and  after  each  trilnlng 
period  and  tested  at  three  week  Intervals  thereafter.  One  group  was  trained  only 
once;  the  two  remaining  groups  were  trained  a  second  time  either  three  or  six 
weeks  after  the  original  training.  Target  recognition  and  Identification  per¬ 
formance  was  assessed  by  four  measures:  1)  Number  of  Slides  Recognized;  2) 

Number  of  Slides  Identified;  3)  Number  of  Vehicles  Recognized;  4)  Number  of 
Vehicles  Identified. 

Implications  of  Sample  Attrition 

As  the  study  progressed,  sample  attrition  resulted  In  some  of  the  more 
detailed  aspects  of  study  objectives  being  deleted  from  consideration. 

Retention  Performance 

Examination  of  performnnce  three,  six  and  nine  treeks  after  an  original 
training  period  Indicated  that  the  greatest  decay  occurs  sometime  within  the 
three  week  period  Immediately  following  training.  Thereafter,  decay  appears 
minimal  (or  non-existent)  for  up  to  nine  weeks.  Decay  following  a  second 
training  period  shows  a  similar  trend.  Based  on  the  results  from  these  limited 
data.  If  performance  levels  reflected  three  weeks  after  training  are  acceptable, 
retraining  Is  not  recommended  until  at  least  the  ninth  week.  The  present  work 
does  not  permit  extrapolation  beyond  this  time. 

Results  cited  above  may  be  limited  by  the  use  of  a  strategy  where  soldiers 
went  through  a  fixed  sequence  of  training  and  testing.  Alternative  strategies 
for  training  which  might  Improve  long-term  retention  Include: 

•  Training  soldiers  until  performance  reaches  a  specified 
criterion.  The  criterion  selected  will  depend  on  cost- 
effectiveness  considerations  associated  with  time  to  train 
to  a  criterion  and  the  resulting  retention  curves. 

•  Retraining  soldiers  less  than  three  weeks  after  original 
training  was  completed.  Cost-effectiveness  concerns  associated 
with  training  time,  meeting  other  training  requirements  and 
resulting  retention  curves  must  be  considered. 
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Retention  Performance  and  Background  Factors 


Among  the  background  factors  explored  In  this  research  were  GT,  rank,  MOS, 
and  use  of  glasses  on  the  job.  Results  indicated  that  soldiers  with  different 
characteristics  may  attain  different  performance  levels  given  a  fixed  amount  of 
training.  Overall  Identification  performance  levels  attained  were  higher  for 
soldiers  who  had  higher  GT  scores.  No  significant  relationships  were  found 
using  Identification  performance  for  either  rank  or  use/non-use  of  glasses.  For 
recognition  performance,  no  significant  relationships  were  found  between  perform¬ 
ance  and  GT  scores,  MOS,  rank  or  use/non-use  of  glasses.  Soldiers  with  an  Armor 
MOS  were  somewhat  superior  to  those  holding  an  Infantry  or  Artillery  MOS.  A 
major  question  In  this  research  was  whether  soldiers  In  different  categories  of 
these  factors  would  show  differential  retention  performance  as  the  time  since 
training  Increased.  Up  to  six  weeks  after  training,  the  answer  almost  uniformly 
was  no.  On  the  average  those  who  performed  poorly  Initially  showed  the  same 
retention  performance  pattern  as  did  those  who  performed  well.  This  research 
Indicates  that  some  soldiers  require  more  training  to  attain  a  specific  level  of 
performance;  however,  once  that  level  Is  attained,  performance  generally  will 
decay  at  about  the  same  rate  for  all. 

In  order  to  formulate  more  meaningful  R&I  training  which  is  cost- 
effective,  the  Army  must:  1)  establish  criteria  for  acceptable  R&I  performance; 

2)  determine  optimal  training  strategies  to  achieve  performance  at  that  level; 
and  3)  make  an  assessment  to  determine  for  whom  the  required  training  would  not 
be  cost-effective  (If  any). 

Effects  of  Retraining 

In  the  analyses  of  the  effects  of  retraining,  two  groups  of  soldiers  were 
used:  one  group  was  retrained  3  weeks  after  the  first  training;  a  second  group 
was  retrained  six  weeks  after  the  original  training.  In  comparing  pretraining 
and  posttraining  test  scores,  overall  analyses  indicated  significant  performance 
Improvement  occurred  as  a  result  of  each  training  period.  Further,  performance 
at  the  end  of  the  second  training  period  was  higher  than  at  the  end  of  original 
training.  On  the  average.  Improvements  In  Identification  performance  are  about 
equal  with  each  training  period;  recognition  performance,  however,  improves  most 
during  the  first  training  period. 

As  In  the  discussion  of  performance  changes.  It  seems  that  the  most 
Important  concern  is  to  devise  a  training  strategy  which  will  optimize  the  speed 
of  learning  and  maximize  retention  over  time.  With  measures  of  performance 
surrounding  only  two  training  periods,  formulation  of  a  recommended  training 
strategy  Is  necessarily  tentative.  If  we  assume  that  the  nearly  Identical 
pretraiiiing  to  posttraining  *'est  improvements  obtained  in  identification  perform¬ 
ance  surrounding  each  of  the  two  training  periods  (separated  by  at  least  three 
weeks)  will  be  the  same  for  subsequently  equally  spaced  training  periods,  an 
extrapolation  of  these  findings  would  permit  an  Inference  that  eight  or  nine  such 
training  periods  would  be  required  before  soldiers  could  correctly  Identify  80% 
of  the  vehicle  Images  presented — for  a  total  of  48. 
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Cost  Effectiveness  Considerations  of  Retraining 

It  Is  apparent  from  review  of  immediate  posttraining  test  data  presented 
herein  that  learning  to  recognize,  and  more  especially.  Identify  friendly  and 
enemy  vehicles  Is  a  difficult  task.  Further,  knowledges  acquired  appear  somewhat 
transient — they  decay  over  time.  Faced  with  such  Information  there  are  at  least 
two  primary  questions  that  should  be  asked.  First,  how  Important  Is  It  for 
soldiers  to  able  to  recognize  and  Identify  friendly  and  enemy  vehicles.  In 
answering  this  question  the  focus  Is  on  materiel  resources  and  people.  If  a 
soldier  Incorrectly  fires  on  one  of  his  own  vehicles  only  one  time,  the  loss  of 
equipment  (not  to  mention  the  training  and  other  costs  Inherent  In  the  loss  of 
lives)  may  be  In  the  millions;  If  he  falls  to  correctly  Identify  an  enemy  he  and 
his  weapon  may  become  the  casualty  with  a  corresponding  loss.  Since  the 
projected  threat-to-frlend  force  ratio  Is  expected  to  be  quite  large  (6:1)  NATO 
units  can  111  afford  to  lose  equipment  or  soldiers  which  further  Increases  the 
ratio.  Apart  from  cost  of  equipment  loss  due  to  Inadequate  R&l  skills,  many  U.S. 
or  allied  soldiers  may  be  killed. 

Second,  given  the  Importance  of  R&l  to  preservation  of  life,  materiel 
resources  and  ultimately  the  wlnnlxig  of  battles,  how  can  these  skills  (or 
functions)  be  best  provided?  The  Combat  Vehicle  Identification  (CVl)  Training 
programs  developed  and  evaluated  by  the  Fort  Hood  Field  Unit  over  the  past  seven 
years  came  out  of  a  concerted  effort  to  employ  the  best  known  methodology  for 
developing  and  evaluating  training  programs  that  could  be  utilized  today  by  a 
large  portion  of  the  American  soldier  force.  The  apparent  demonstrated 
difficulty  of  acquiring  and  retaining  these  R&l  skills  should  stimulate  further 
research.  Electronic  Identification  Friend/Foe  (IFF)  has  been  widely  discussed 
In  the  R&l  community  as  a  means  to  resolve  this  problem.  However,  movement  from 
the  conceptual  stage  to  developmental  and  Implementation  phases  has  been  slow. 

The  Army  cannot  wait  for  advanced  technology  to  resolve  the  R&I  problem.  Given 
the  need  and  the  difficulty  of  acquisition  and  retention,  more  research  and 
development  In  this  area  Is  clearly  needed.  Indeed,  over  the  past  seven  years 
the  Target  Acquisition  and  Analysis  Training  System  (TAATS)  has  sought  to  explore 
how  to  optimize  acquisition  (and  retention)  of  R&l  skills  with  the  programs 
currently  in  the  Army  inventory.  The  current  research  supports  the  value  of 
retraining — specifically  retraining  does  lead  to  higher  levels  of  demonstrated 
R&l  skills.  Related  research  also  supports  the  efficacy  of  retraining  on 
acquisition  of  R&I  skills — most  especially  for  about  2/3  of  the  soldiers  trained. 
Research  utilizing  ASVAB  data  and  the  background  characteristics  of  soldiers  who 
have  participated  In  the  TAATS  research  effort  is  concurrently  underway  to 
determine  whether  the  soldiers  who  prove  most  trainable  can  be  identified  prior 
to  Army  training.  Since  the  Army  has  limited  training  time  available.  It  Is 
Important  to  Indicate  the  level  of  committment  that  training  and  retraining  will 
require.  Documentation  describing  the  Basic  CVl  program  (Smith  et  al.  1980) 
Indicates  training  on  one  module  takes  a  maximum  of  50  minutes.  Variation  In  time 
required  Is  dependent  largely  on  the  number  of  questions  or  amount  of  discussion 
by  soldiers  In  the  "manual  presentation  phase”  of  the  training.  Research  with 
this  program  Indicates  that  for  the  first  training  session,  40  minutes  per  module 
Is  a  good  average.  With  six  training  modules  then  per  session,  the  complete 
first  training  session  involves  about  4  actual  hours  of  training.  Army  training 
schedules  generally  should  provide  for  training/ testing  two  modules  per  day. 
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Again,  research  Indicates  that  for  the  second  training  session  fewer  questions 
and  less  discussion  makes  30  minutes  per  module  a  good  average.  For  subsequent 
training  sessions  this  time  Is  reduced  to  approximately  20  minutes  per  module. 
With  these  estimates  then,  actual  training  and  testing  time  for  three  complete 
sessions  of  six  training  and  a  final  test  module  Is  about  9  hours. 
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CONCLUSIONS 


1.  The  greatest  decay  in  recognition  and  identification  performance  after 
CVI  training  occurs  within  the  three  week  period  Immediately  following 
the  training.  Thereafter  decay  appears  minimal  or  non-existent  for  up 
to  nine  weeks.  The  current  research  did  not  deal  with  retention  beyond 
nine  weeks. 

2.  Different  soldiers  require  differing  amounts  of  CVI  training  to  attain 
specific  levels  of  performance;  however,  once  a  specific  level  is 
attained,  performance  generally  decays  at  the  same  rate  for  all. 

3.  Significant  performance  Improvement  occurs  after  initial  training,  and 
also  after  a  second  repetition  of  this  training  three  weeks  later,  and 
also  when  the  second  repetition  is  given  six  weeks  after  initial 
training. 

A.  Combat  vehicle  Identification  performance  levels  obtained  as  a  result  of 
CVI  training  are  correlated  with  GT  score. 
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APPENDIX  A 

Privacy  Act  Statement  and  Training/Testing  Worksheets 


DATA  REQUIRED  BY  THE  PRIVACY  ACT  OF  1974 
IS  u.xe.  ssui 


TiTLtoR^oRM  Combat  Vehicle  Identification  (CVl) 

Training  Froareun  -  Soldier  Information 

PRISCRiaiNO  OIReCTIVB 

AR  70-1 

1.  AUTHORITY 

10  use  Sec  4503 

2.  PRINCIRAL  PURPOSSISI 

The  data  collected  with  the  attached  form  are  to  be  used 
purposes  only. 

for  research 

3.  nOUTINI  uses 


This  is  sn  •xpsrimental  psrsonnsl  data  collactlon  fora  davalopad  by  tha 
a.S.  Amy  Rosaarch  Insbituba  for  tha  Behavioral  and  Social  Sciences*  pvirsuant 
to  its  research  mission  as -prescribed  in  AR  70-1.  When  identifier  (name  or 
Social  Security  Number)  are  requested  they  are  to  be  used  for  administrative 
and  statistical  control  purposes  only.  Full  confidentiality  of  the  responses 
will  be  maintained  in  the  processing  of  these  data. 


4.  MANOATOHY  OR  VOUUNTARY  OISCUOSURI  ANO  tARSCT  ON  INDIVIDUAL  NOT  PROVIDINQ  INRORMATION 

Your  participation  in  this  research  is  strictly  voluntary.  Individuals  are 
encouraged  to  provide  complete  and  accurate  information  in  the  interests  of 
the  research r  but  there  will  be  no  effect  on  individuals  for  not  providing 
all  or  any  part  of  the  information.  This  notice  may  be  detached  from  the 
rest  of  the  form  and  retained  by  the  individual  if  so  desired. 

FORM  Privacy  Act  Stitiwunt  •  26  S<p  75  | 


DA  Form  4368-R,  1  Miy  75 
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Module  No. 
Seat  # 


SOLDIER  WORK  SHEET 


SOLDIER  NAME  RANK 


MODULES  1>6 


Section  A;  Manual  Presentation  Sequence 


Trial 

Friend/ 

Threat 

Vehicle 

Description 

Trial 

Friend/ 

Threat 

Vehicle 

Description 

1 

14 

2 

15 

3 

16 

4 

17 

5 

18 

6 

19 

20 

i 

21 

9 

22 

10 

23 

11 

24 

12 

25 

13 
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r 


Module  No. 
Seat  # 


SOLDIER  WORK  SHEET 


SOLDIER 

NAME 

RANK 

MODULES 

1-6 

Section  B:  Automated  Presentation 

Sequence 

Friend/ 

Vehicle 

Friend/ 

Vehicle 

Trial 

Threat 

Description 

Trial 

Threat 

Description 

26 

39 

27 

AO 

28 

A1 

29 

A2 

30 

A3 

31 

AA 

32 

A5 

33 

A6 

34 

A7 

35 

A8 

36 

A9 

37 

50 

38 

A-A 


Module  No. 
Seat  # 


SOLDIER  ANSWER  SHEET 

Soldier  Name _ Rank _ 

MODULES  1-6 

Section  C;  Module  Test  (Automated) 

(8  second  exposure) 

Trial  Friend/Threat  Vehicle_Descrlptlon 

1 _ _ 

2  _  _ 

3  _ _ 

4  _ _ 

5  _ _ 

6  _ _ 

7  _  _ 

8  _ _ 

9  _ _ 

10  _  _ 

11  _  _ 

12  _  _ 

13  _  _ 

14  _  _ 

15 


A-5 


DATE _ 

MODULE  NO. 

SEAT  # _ 

RANGE 


BASIC  COMBAT  VEHICLE  IDENTIFICATION  (CVI)  TRAINING  PROGRAM 


MODULE  7 

SOLDIER  INFORMATION 

1.  Name: _ 

(Last)  (First)  (MI) 

2.  Rank: _  3.  SSN: _ 

A.  Age: _  3.  Military  Unit: _ 

6.  Time  in  Service: _ _ 

(Years)  (Months) 

7.  MOS: _ 

8.  Length  of  time  in  MOS:  _  _ 

(Years)  (Months) 

9.  Uhat  is  the  MOS  of  the  job  to  which  you  are  currently  assigned? 


10.  Do  you  wear  glasses  (or  contact  lenses)  on  the  job? 
Yes  No 


10a.  Do  you  wear  glasses  (or  contact  lenses)  only  for  reading? 
Yes  No 
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PRE-POST  TEST  -  SOLDIER  ANSWER  SHEET 


Vehicle 

Vehicle 

Slide  # 

Friend 

Threat 

Description 

Slide  # 

Friend 

Threat 

Description 

1 

0 

0 

31 

0 

0 

2 

0 

0 

32 

0 

0 

3 

0 

0 

33 

0 

0 

4 

0 

0 

34 

0 

0 

5 

0 

0 

35 

0 

0 

6 

0 

0 

36 

0 

0 

7 

0 

0 

37 

0 

0 

8 

0 

0 

38 

0 

0 

9 

0 

0 

39 

0 

0 

10 

0 

0 

40 

0 

0 

11 

0 

0 

41 

0 

0 

12 

0 

0 

42 

0 

0 

13 

0 

0 

43 

0 

0 

14 

0 

0 

44 

0 

0 

15 

0 

0 

45 

0 

0 

16 

0 

0 

46 

0 

0 

17 

0 

0 

47 

0 

0 

18 

0 

0 

48 

0 

0 

19 

0 

0 

49 

0 

0 

20 

0 

0 

50 

0 

0 

21 

0 

0 

51 

0 

0 

22 

0 

0 

52 

0 

0 

23 

0 

0 

53 

0 

0 

24 

0 

0 

54 

0 

0 

25 

0 

0 

55 

0 

0 

26 

0 

0 

56 

0 

0 

27 

0 

0 

57 

0 

0 

28 

0 

0 

58 

0 

0 

29 

0 

0 

59 

0 

0 

30 

0 

0 

60 

0 

0 
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